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ON INFINITE SYSTEMS OF LINEAR INTEGRAL EQUAT ONS. 

By Lotus Brand. 

The principal problem of this paper is the solution of a denumerably 
infinite system of linear integral equations of the type 






<Pi(x)£(x)dx = bi (i = 1, 2, • • •), 



the <p's being given functions and the b's given constants. The solution 
of such a system of equations, besides its intrinsic importance, enables us 
to approach in a simple manner other matters such as the existence of 
biorthogonal systems of functions and the expansion of an arbitrary function 
in terms of a given system of functions by the method of least squares. 
The method of procedure is closely analogous to that employed in an earlier 
paper in these Annals* by Professor Bdcher and myself, treating of the solu- 
tion of an infinite number of linear equations in an infinite number of 
unknowns, and is chiefly characterized by the preliminary solution of a finite 
number of equations and the treatment of the infinite system as a limiting 
case. The trend of this analogy is fully exhibited in Theorems 1 and 2 ; subse- 
quently the proofs of the theorems having close analogues in (I) are given in 
much less detail — sometimes in mere outline when reference to this article 
will make the detailed procedure evident. 

This paper is a development of a manuscript handed me by Professor 
B6cher a year ago in which the method of proceeding for §§2, 3, and the 
beginning of § 6, was sketched in outline. This manuscript was written 
in June, 1910, several months before the appearance of a paper by F. Rieszf 
in which it was mentioned how Schmidt's method,! of which a modification 
is used in (I), can be applied to the problem here considered. The method 
here developed has in comparison to that suggested by Riesz§ all the ad- 
vantages which the treatment in (I) has over the original treatment of 
that problem by Schmidt. 

1. We will consider real or complex functions of the real variable x 
on the arbitrary interval a £ x ^ b, denoting such functions by /, <p, etc., 

* June, 1912. This article will be referred to as (I). 

t "Systeme integrierbare Funktionen," Mathematische Annalen, 69 (1910), p. 451, p. 469. 

% "tJber die Aufiosung linearer Gleichungen mit unendlich vielen Unbek&nnten," Rend. Circ. 
Matem. Palermo, 25 (1908), pp. 53-77. 

§ The method actually used by Riesz in the article above cited differs from both of these and 
leads to different results. 
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102 LOUIS BRAND. 

and their conjugate imaginary functions by /, 7p, etc., omitting the argu- 
ments. All integrals shall be taken in the sense of Lebesgue, and the 
term integrable shall mean integrable in this sense* on the interval (a, b). 
Q is the class of all such functions <p for which |^>| 2 is integrable. It 
may be readily shown that if |^| 2 is integrable (we denote functions 
of the class fi by Greek letters) both \<p\ and <p are integrable.f But 
the chief characteristic of functions of the class ft is expressed in the follow- 
ing theorem: The 'product of any two functions of the class Q is integrable; 
and every function which yields an integrable product with all the functions 
of the class Q is itself a member of this class.t From this theorem it follows 
that the sum of two functions of the class Q is likewise a member of this 
class; or, more generally, any linear combination of functions of the class 
Q belongs to this class. 

A function is said to be essentially zero if it differs from zero merely on a 
point set of content § zero. The integral of a function essentially zero is, 
of course, zero. The n functions /i, • • • , /„ are said to be essentially linearly 
dependent in (a, b) if there exist n constants, C\, • • •, c„, not all zero, such 
that Ci/i + • • • + c n fn is essentially zero in this interval. 

By the norm of a function <f> of the class fl is understood the real constant 



norm 






Norm <p = when and only when <p is essentially zero, and is otherwise 
positive. 

In the following we shall omit the limits of integration, a, b, and the dx 
in writing integrals; these are to be understood in all cases. 

2. Consider now the system of n homogeneous integral equations 

(1) /?,£ = 0, f<p 2 H = 0, • • •, JV„£ = 0, 

where <pi, <pt, • • •, <p n are functions of the class Q. We propose to determine 
all the functions £ of the class Q, satisfying (1). 

Theorem 1. If £ is a solution of (1) which is essentially linearly de- 
pendent upon vuVti ' ' ">Vn, then $ is essentially zero. 

Suppose that 

£ = Ci<pi + C 2 ^2 + • • • + CnVn 

♦Lebesgue, Lemons sur l'integration, Paris (1904), p. 115. Lebesgue terms functions in- 
tegrable in this sense sommdble. See also F. Riesz, 1. c, § 1. 

t Cf. F. Riesz, 1. c, § 2. 

t Lebesgue, "Sur les integrates singulieres," Annates de la Faculty des Sciences de Toulouse, 
3° serie, 1. 1, p. 37, p. 39; F. Riesz, 1. c, p. 459. Riesz proves a more general theorem than the one 
stated above. 

§ Content as defined by Lebesgue, Lecons sur l'int6gration, p. 102 et seq., i. e., mesure. 
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(essentially). Multiplying equations (1) by c"i, ~c 2 , • • •, c„ respectively and 
adding we get 

f(ci<pi + c 2 <P2 + ■■■ + c n <p n )£ = ftt = /|£| 2 = 0. 

Hence £ is essentially zero, as was to be proved. 

We are now in position to obtain a criterion for the essential linear 
dependence of n functions of the class $2. If <pi, <p 2 , • • •, <p n are essentially 
linearly dependent 

Ci<pi + c 2 <P2 + • • • + c„<p n = 

(essentially), where not all of the c's are zero. Multiplying this relation 
in succession by £i, <p 2> ■ • ••, £„, and integrating from a to b we get the n 
equations 

Cif<Pi<Pi + c 2 j <p»jpi + • ■ • + c n f(p n <Pi = (i = 1, 2, • • •, n). 

Since the c's are not all zero the determinant of this system must vanish; 
thus, interchanging rows and columns in this determinant, we have 



(2) 



j <Pl<Pl J <Pl<P2 • ■ ■ J <Pl<Pn 
J <P2<Pl J <P2<f>2 • * * J <P2<Pn 

j <Pn<Pl J <Pn<?2 ••• J <Pn<Pn 



= 0. 



This relation is therefore a necessary condition for essential linear de- 
pendence. 

It is also a sufficient condition. For suppose that (2) is fulfilled; then 
the n sets of constants forming the rows of the determinant are linearly 
dependent, and we have 

f$i(Ci<pi + C 2 <P2 + • • • + C n <Pn) =0 (i = 1, 2, • • •, n), 

where not all of the c's vanish. From Theorem 1 we now readily infer 

that 

C\<P\ + C 2 <P2 + • • • + C n <f>n = 

(essentially), which establishes the essential linear dependence of <pi, <p 2 , 

We term the determinant in (2) the Gramian of <pi, <p 2 , • • • , <p n and denote 
it by G(<p u <p 2 , • • •, <p n ). Thus we have 

Theorem 2. A necessary and sufficient condition that the n functions 
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<P\, <pz, • • • , <p n of the class ft be essentially linearly dependent is that their 
Gramian vanish* 

We turn now to the solution of the system (1), assuming that <pu <P2, • • •, 
<p n are essentially linearly independent, so that (?(<pi, • • • , <p n ) 4= 0. This 
entails no loss in generality ; since if, for example, <p„ were essentially linearly 
dependent on <p x , • • •, <p„_i, the equation J <p n £ = would be satisfied by 
all the solutions of the preceding system and could therefore be omitted. 
Every solution £i of (1) of the class ft may be written in the form 

(3) £l = CVPl + • • ■ + CrJfn + rj, 

r] being some function of the class ft. In order that this be a solution the 
constants c,- must satisfy the system of linear equations 



Cy 



f<P#>\ + ■ • ■ + Cnfvwn + f<piv = (i = 1, 2, • • •, n)> 



which may be solved by Cramer's rule as their determinant is precisely 
G(<f>i, • • •, <p n )- These values substituted in (3) give 



/ <PlVl ■ ■ ■ J <Pl<Pn J <PlV\ 



1 






\J <Pn<f»l 

! <Pi 


■ ■ J (p n (pn 
<Pn 


J <PnV 



(4) 



G(<pi, ■ • -, <p„) 

That, no matter what the function 77 of the class ft may be, the formula 

(4) always gives a solution of (1) belonging to this class is seen by direct 
substitution. 

Theorem 3. If in equations (1) <p h <p 2 , ■ • -, (p„ are essentially linearly 
independent functions belonging to the class ft, their general solution of this 
class is given by (4), 77 being an arbitrary function of the class Q.f 

A line of reasoning analogous to that on p. 171 of (I) shows that two 
different ^'s yield essentially the same £1 when and only when their differ- 
ence is essentially linearly dependent upon <pi, $2, • • •» <Pn- 

To find a formula for norm £1 we form f £ih from (3), whence, remem- 
bering that the norm is real, 

(5) norm $1 = frfy, 

* We note in passing that <pi, <pi, • • -, <p n are connected by the same linear relation that connects 
the rows of their Gramian, written as above. 

t If i) is given the solution {1 is essentially unique. 
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and from (4) the latter integral is seen to be equal to 

G(<Pl, • • •_, (fin, V) 



(6) 



norm ti = 



G(<Pl, • ■ ■, <Pn) 



Just as in (I), p. 171, this relation may be used to establish 
Theorem 4. The Gramian of any number of essentially linearly in- 
dependent functions of the class Q is real and positive. 
3. We now pass to the non-homogeneous system 



(7) 



f <p\£ - b u f<p 2 £ = b 2 , 



f<Pn£ = b n 



where we again assume that <p x , • • •, <p„ are essentially linearly independent 
functions of the class 0. We seek a solution of the form 



(8) 



$0 = Ci^i -+■••• + C n <Pn- 



Substituting this in (7) we obtain n linear equations to determine the c's. 
These can, as above, be solved by Cramer's rule; and the result substi- 
tuted in (8) gives 

J Wl • • • J <Pl<Pn ~ bi 



(9) 



€o = 




G((f h ■ ■ ■, <p n ) 

That this is really a solution of (7) we see by direct substitution. Hence 
we may state 

Theorem 5. If <pi, <p 2 , • • • , <p n are essentially linearly independent 
functions of the class Q, the equations (7) have one and only one solution of the 
form (8), and this is given by (9). 

The general solution of (7) is obtained by adding to the particular 
solution (9) the general solution (4) of the homogeneous system (1); it is 
therefore 

J (fl<fl ■■■ J (Fl<Pn J<PlTJ — bi 



(10) 



£ = to + fc = 




G(<Pl, •••, <fi n ) 



The solution (9) of (7), which is characterized by being the only solution 
of (7) which is linearly dependent upon the £'s, shall be called the principal 
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solution of (7). Another characteristic property of £o, which can be readily 
deduced from (10) and (8), is that 



(11) 

and hence 



norm £ = norm £<r+ norm £i 
norm { ^ norm | , 



the equality sign holding only when £i is essentially zero, in which case 
£ and £ are essentially equal. Thus we have 

Theorem 6. Among the solutions of (7) no others have so small a norm 
as the principal solution except those essentially equal to it. 

To obtain a formula for norm £ we form f £ £o from (9) : * 



(12) 



norm £ = 




G(<fii, ■ • -, <p n ) 

Norm £ is now given by (11). 

Let us now write those particular c.'s which when substituted in (8) 
give £ as c,°, so that 

£o = C x °^i + • • • + c„°£„. 
Then 



(13) 



norm £ = f Solo = 2 c»°b,. 



We now inquire as to what special role the solution £ plays in the totality 
of expressions essentially of the form 2"=i c^ h regarded as functions of the 
c's, which may vary subject to the condition 



(14) 



norm 21 c>£» = S c,b t - 



suggested by (13). For a convenience in the following argument we will 
exclude the case c x - c 2 = • • • = c„ = 0; then, as the <p's are essentially 
linearly independent, (14) requires, in particular, that 2" =1 dbi be always 
real and positive. Letting £ represent an arbitrary solution of (7), we 
have from Theorems 2 and 4 



* As in (I), p. 173, footnote, we may use (12) to prove the theorem: // the Gramian of essen- 
tially linearly independent functions of the class il is bordered by constants, which do not all vanish, so 
as to form a bordered Gramian of the type of that in (12), this bordered Gramian is negative. 
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/III 2 f&CiVi 

f&C&i /|2c,vi|* 



(?& 2c^,) = 
or 



^,0, 



In view of (14) this yields 

(15) norm £ ^ 2c,£,-, 

the sign of equality holding when and only when £ and 2cj£,- are essentially 
linearly dependent. This is clearly not the case when £ is essentially not 
of the form 2c,£,-, i. e., when £ is essentially different from £ ; hence writing 
d = d° in (15), we have that norm £ > norm £ except when £ and £ 
are essentially equal. This constitutes another proof of Theorem 6. 
Again, letting £ = £ in (15), we have 

norm £ ^ 2c6„ 

the equality sign holding only when 

£o = k2Ci<?i 

(essentially), in which case we find from (14) 

norm £ = I k | 2 2Cjb, = &2C.&,-. 

Hence k = 1, the value & = being excluded as £ is not essentially zero, and 

2( C< ° - *)v t = 

(essentially), which, in view of essential linear independence of the <p's, can 
only be true when d" = c Thus we have shown that the polynomial 
2CfS f in Ci, • • •, c„, when subject to the condition (14) attains its maximum 
value, norm £ , when and only when c,- = d°. 
Theorem 7. In the principal solution 

£o = ci°£i + • • • + c„°£„ 

the constants (ci°, • • • , c„°) form that set of values which render the polynomial 
cibi + • • • + cj> n a maximum when it is subject to the condition (14). 

Thus the finding of the principal solution of equations (7) may be 
regarded as a problem in conditional maxima, and in fact £o niay be obtained 
by the classical procedure for such problems.* 

4. Before giving an application of the preceding results we lay down 
the following definitions : 

* See F. Riesz, I. c, § 9, where a more general problem is treated in this way. 
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A function of the class Q is said to be normalized when its norm is 
unity. 

Two functions <p, $ are said to be orthogonal in the interval a ^ x ^ & 

if I ^dx, and hence also I ^dx, is zero. The system of functions { <pi } , 

%) a. • '« 

finite or infinite in number, is termed orthogonal in the interval a ^ x ^ & 
when 

I v&jdx = I vi<pjdx = (i+j). 

We now propose to solve the problem: (?wen i/ie system of functions 
{<Pn\ of the class Q, none 0/ w/iicli are essentially linearly dependent, to find 
a system of normalized, orthogonal functions {$„} such that 

isxn 

$ n = 21 a ni (pi, a nn 4= 0, 

the a's being constants. 

<£„ must satisfy the n equations 

(t 4= n), 

(t = n) ; 

and upon substituting for i>» the linear expression in the £'s an evident 
reduction yields the equivalent system 

/£i£ = 0, /^{ = 0, ■■■, /*_i$ = 0, /£„$==-. 

" "-nn 

From Theorem 5 we see that the only solution of this system having the 
form of <£„ is its principal solution £ . To determine a„» we have from (12) 

1 <Jn-l . 

norm £ = — — if • ~r~ = 1 > 



/«- 1 



(16) 



I , __ | <Jn-l 



where we have written G n = G(<pi, • • • , <p n ) = G{<p\, • • ■ > £») with the 
convention that Go = 1. Thus, choosing a nn in accordance with (16), 
we may write 5>„ = So- However <£>„ is not uniquely determined for there 
are infinitely many complex numbers satisfying (16) ; b ut if we impose the 
further condition that a„„ be real and positive a„„ = VGn~i/G n and $„ will 
be uniquely determined. Then we have from (9), after interchanging rows 
and columns in the determinant in the numerator,* 



* These formulae are given by Kowalewski, Einfuhrung in die Determinantentheorie, Leipzig 
(1909), p. 337. 
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(17) 



dE> = 



1 



VGn-Sr. 



j <p£j)\ 



J <Pl<Pn-l <Pl 
J <P2<Pn-l <P2 



f<p, 



f>\ 



J <pn?n-l <Pn 



(n = l,2, •••)• 



Denoting the cofactor of the element in the last column and ith row of 
G n by G„ (i) , it is clear that 

(18) a ni = -^= (i = l,2, -..,«). 

Thus the problem is solved; if we require that a nn be real and positive 
there is only one solution and this is given by (17). 

5.* We proceed to establish two important inequalities. If <p and yp 
are functions of the class Q we have from Theorems 2 and 4 that G(<p, ~\p) ^ 0, 
which upon expansion gives Schwarz's Inequality: 

(19) !/^[/M']*[/liM\|*. 

Applying this result to f (<p + \}/)(<p + \p) we deduce further that 

(20) [/k + *l']*^[/kl»] l + [/|^|»]». 

We next lay down the following 

Definition. The sequence of functions {<p„} of the class Q is said to 
converge in the mean to the function <p of this class if 



lim J*|<p 



-o,t 



and we write Jim <p n = <p. 

nsoo 

The function <p is essentially unique; that is, if {<?„} converges in the 
mean to both <p and $, these functions are essentially equal. For by (20) 

[f\<P ~ H*]* = [f\<P ~ <Pn + <Pn ~ ^| 2 ]* ^ [f <P ~ <Pn\*]*+ [f \ <Pn~ tl^ , 

and upon passing to the limit n = oo we have f | <p — \f/ 1 2 = 0. 

It is clear that uniform convergence implies mean convergence. On 

* This article is closely analogous to § 5 of (I), to which reference should be made for details 
of proofs. 

fE. Fischer, "Sur la convergence en moyenne," Comptes Rendus, May, 1907, p. 1022. 
For a generalization of this conception see F. Riesz, 1. c, p. 464. 

We note also that if the sequence W»} of the class Q fulfils this relation, <p is necessarily of 
the class Q. For the definition implies that <p — <p n is of the class Q for sufficiently large values of 
n, and hence the sum of <p — <p n and <p n is also of this class. 
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the contrary, mean convergence does not even imply convergence in the 
ordinary sense. 

If hm <p n = <p, hm \p n = $, it follows from (20) that 

(21) lim (<p n + f % ) = <p + }. 

n=oo 

Furthermore 

(22) lim f<p n ^n = <pt 

n=ao 

as we readily prove upon writing 

/ (<p^ - <p n \l/ n ) = f (<p - <p n )yp + f {ip - ip n )<p — f (<e - <f> n )(f — ^«) 
and applying (19). Important special cases of (22) are 

(23) lim / <p n $ = f <pt; 

tt=:00 

(24) lim norm <p n = norm <p. 

We now state without proof an important criterion for mean con- 
vergence due to E. Fischer.* 

Theorem 8. A necessary and sufficient condition that the sequence of 
functions {<p n } of the class Q converge in the mean to a function of this class 
is that to every positive e there correspond an integer N such that 

f\<Pn — <Pm I. 2 < e, m,n> iV.f 

The infinite series of functions of the class Q, <pi + <? 2 + • • • , is said 
to converge in the mean to the function a when the sum of its first n terms, 
c n , converges in the mean to a. From Theorem 8 we see that a necessary 
and sufficient condition for the mean convergence of the above series is 
that, to every positive e, there correspond an integer JV such that 

(25) f\a n -<T m \ 2 = f\<p m+ i+<p m +2+ |-^n| 2 <€, m,n>N. 

If the <p's are all mutually orthogonal (25) becomes 

f\cp m+1 \* + f\<p m+i \*+ ••• +f\<p n \ 2 <e, m,n>N; 

and as this is precisely a necessary and sufficient condition that the series 
f I V\ I 2 + S W 2 + • • • converge, we have proved 

* Sur la convergence en moyenne, 1. c. 

tThe apparently redundant phrase "to a function of the class Q" is inserted because E. 
Fischer defines the sequence to be convergent in the mean when this relation holds and then estab- 
lishes the existence of a function of the class £2 to which the sequence converges in the mean. 

For other proofs of this theorem see Weyl, "TJber die Konvergenz von Reihen die nach Or- 
thogonalfunktionen fortschreiten," Mathematische Annalen, 67 (1909), p. 243; Plancherel, 
"Contribution a l'6tude de la representation d'une fonction arbitraire," etc., Rend. Circ. Matem. 
Palermo, 30 (1910), p. 292. See also F. Riesz, 1. c, p. 468, where a generalization of this theorem 
is proved. 



ON INFINITE SYSTEMS OF LINEAB INTEGRAL EQUATIONS. 



Ill 



Theorem 9. A series of mutually orthogonal functions of the class Q 
converges in the mean to a function a of this class when and only when the 
series of their norms converges* 

Moreover as 

f\'»\*-f\<Pl\' + f\<P*\ , + ••■ +f\<Pn\ 2 

we infer from (24) the 

Corollary. // the conditions of Theorem 9 are fulfilled, the norm of the 
function a is equal to the series of the norms of the terms. 

6. We are now in position to consider the infinite system of homo- 
geneous equations 

(26) JVi£ = 0, /^ = 0, 

where we assume that <p\, <p 2 , • • • are all of the class Q and none of them 
are essentially linearly dependent. The general solution of the first n 
of these equations, which we denote by £i (n) , is given by formula (4). We 
now express £i (B,) as the sum of m terms of a series, writing 

& w = & (0 + E(€i < - ) -{i ( "- 1) ); 

and by means of a device entirely analogous to that used in (I), pp. 179, 
180, we find thatf 

(27) ^^-ItAt^ 

n=l u»- ltr„ 

where we have written 

j <Pl<Pl • • • J <Pl(pn 



$1 = <Pl, $n = 



J <Pn-l<Pl • ■ ■ J <Pn-l<Pn 



(n = 2, 3, •••), 



*-/ 



<PiV, 



H n = 



f <Pl<Pl ■ ■ ■ J <PlVn-l f <PlV 

J <PiV\ • ■ • j <P2<Pn-l j Vih 

j <Pn<Pl • ■ ■ j <f>n<Pn-l J <p n rj 



(n = 2, 3, •••), 



* It is easily seen that this theorem still holds if the condition of orthogonality is replaced 
by the less restrictive requirement that the real part of fviVi vanish, i. e., 

J <pw + J Viv, =0 (i +i). 
t Cf. equation (30) of (I). The notation used above corresponds with that of (I). 
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Go = 1, G n = Q{ Vl , •••, Vn ), (n = 1, 2, 3, •••)• 
The ^'s are all mutually orthogonal functions of the class H; for as 

ftn<Pi = ffnVi = (t = 1, 2, • • •, Tl - 1), 

we have 

Moreover we have the relations 

jH'nY = f tn^n — J^n<PnG„-l = G„G„-i, 
Jypn-q = Hn, J^nV = H n , 

so that (27) may be put in the form 

(28) L'^ii-lY— ^, 

B=1 J \tn\ 2 

From (5) we have 

norm fc«-> = /,&<-> -/|,|» - £ ^^f^, 

which shows that the series of positive or zero terms 

is convergent for every function 17 of the class Q since the sum of its first 
m terms is not greater than f \y\ 2 . Now this series is precisely that formed 
by the norms of the terms of the series 

(29) ±fo tn 

whose terms are all mutually orthogonal; hence by Theorem 9 the series 
(29) converges in the mean to a function of the class Q when 77 is a function 
of this class, as does likewise the series obtained from (28) by extending 
the summation to n = <x>. Thus we have shown the existence of a function 
£1 = hm £i <m) , and from (23) it is clear that £1 is a solution of equations (26). 

m=Qb 

Conversely, if £1 is any solution of these equations we may obtain it by 
putting rj = £i in (28) ; for then all the terms after the first vanish. We 
therefore have 

Theorem 10. If -q is a function of the class Q, the function £i (n) given 
by formula (4) converges in the mean as n becomes infinite to a function £1 
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of the class Q which is a solution of equations (26). Conversely, every solution 
of (26), whether of the class J2 or not, can be obtained in this way by properly 
choosing 77. 

The corollary to Theorem 9 shows that 

=0 \f\pnv\ 2 

(30) norm £i = norm 77 — 2 /* . 

Referring to (6) we see that we may also write 



(30)' norm fr = lim 



G(<pi, • • •, <f> n ) 



Definition. A system of functions of the class £2 is termed complete 
in the interval (a, b) if there exists no other function of this class, not essentially 
zero, which is orthogonal to all the functions of the system in this interval. 

If the system {<p„} is complete the equations (26) have no solution not 
essentially zero; then norm £1 = 0, and in view of (30) we have 

Theorem 11. A necessary and sufficient condition that the system of 
functions {<p n \ of the class fl be complete is that, for any function r\ of this 
class, we have 

(31) norm 77 = 2- —?. — zr, 

or 

(32) ]im g ft; * u '"' y ; } = 0. 

In terms of the normalized orthogonal system {*„} formed from {<?„} 
as indicated by (17), the condition (31) takes the form 

00 

(33) norm 17 = 2 J*n»?i 2 
since 

iJVnT/l 2 [g„|2 . 

If the system { <p» } is incomplete we see from (30) that 

(34) norm r; ;> 2 |/*»i?i 2 

so that the series on the right is convergent whenever 77 is of the class £2. 

In the important case in which { <p„ } is a normalized orthogonal system 
we may put <i>„ = <p n in (33) and (34), which then yield the well-known 
Vollstdndigkeitsbedingung and Bessel's Inequality respectively. 



r n = 2 a n k<Pk (n = 1, 2, • • •)> 
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7. We proceed to apply the foregoing results to the problem of expanding 
an arbitrary function in terms of a preassigned system of functions by the 
method of least squares.* 

Theorem 12.| Let 8 be any function of the class Q and \<p k ] a complete 
system of functions of this class none of which are essentially linearly de- 
pendent. Then if the constants a nk in the finite series 

k=n 

are chosen so that norm (8 — <r„) has the smallest value, 

lim ff n = 8. 

n— oo 

Writing 

a nk - a nk ' + ia n k", a nk = a„ k ' — ia nk " (k = 1,2, ■■-, n), 

and employing the classical procedure to find the values of the 2n constants, 
a„k', a n k" which render 

I„ = norm (0 — <r„) = / (8 - <r„)(0 - <r„) 
a minimum, we find that 



(35) 



4~ =-/[(*- °n)Vk +(6- Z n )<Pk] = o, 
OClnk 

(k = 1,2, ••-,71) 

77= if[(e - *n)ik - - CM = 0; 



dank 

(3o) ^ = -: = I J <Pk<Pk > U, t- yrz 7, = U, 

da nk * da n k" J da n kda n k 

noticing that <p k is not essentially zero as none of the <p's are essentially 
linearly dependent. Now equations (35) are equivalent to 

/ (8 - <T n )v k = 0, 

(k = 1, 2, ■■•, n) 

J (0 - ?„)*>* = 0, 

either set of which follows from the other. Thus 8 — <r„, which is a linear 
combination of and the £'s, is a solution of the homogeneous equations 
J (p k % = (k = 1, 2, • • •, n), and is therefore uniquely determined by 
formula (4) upon putting r\ = 8. In view of (36) this expression for 
8 — a n gives I n its minimum value, which by (6) is 

* See Gram, Uber die Entwickelung reeler Funktionen in Reihen mittelst der Methode der 
kleinsten Quadrate, Crelle, 94 (1883), pp. 41 T 73. 

Byerly, "Approximate Representation," Annals of Mathematics, Ser. 2, 12 (1911), pp. 128-148. 
t Cf . Gram, 1. c, p. 59. 
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norm (0 — <r n ) = —pq r~ . 

Since the system [<?*} is complete we have from Theorem 11 that 

lim norm (6 — <r„) = 0, 

nssoo 

or, in our notation, lim <r„ = 6, as we wished to prove. 

n=oo 

8. Lastly we consider the infinite system of non-homogeneous equations 
(37) fvit = b u JW = & 2 , 

where we again assume that <p\, <f>z, • • • are all of the class Q and none of 
them essentially linearly dependent. The principal solution of the first 
n of these equations, which we will denote by £o (n \ is given by formula (9), 
and an argument similar to that used in (I), p. 182, shows that we may write 
£o (m) as the sum of m mutually orthogonal functions of the class ft, 

n—m Z> 

tAm) = J* Dn J. 
SO — /—i ri p Yn, 

»=1 VTn—llTn 



where ^n is defined as in § 6 and 



Bi = 6t, B n = 



f 



<Pi<Pi 



• J <Pl<Pn-l 



6i 



f<Pn<Pl 



J <PnV 



n— 1 



(n = 2,3, •••)• 



Theorem 9 shows that £ Am) will converge in the mean to a function of the 
class Q, when and only when the norms of the terms of the series 



B n 



Y-n 



n=l Gn-iG 

form a convergent series. Thus when 

08) zpi 

n=l **n— lUn 

converges there exists a function £ = hm £o (n) of the class Q, and from (23) 

we see that £ is a solution of (37). Now if the equations (37) have any 
solution, f, of the class Q, then, £ (m) being the solution of least norm of the 
first m of these equations, 

norm £o (m) ^ norm £; 
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and as norm £ <m) is precisely the sum of the first m terms of series (38), 
whose terms are never negative, this series converges. Thus we have 
proved 

Theorem 13. A necessary and sufficient condition that equations (37) 
have a solution of the class Q is that series (38) converge. When this is the 
case £ ( "\ given by formula (9), converges in the mean to a function of the class 
Q as n becomes infinite, and this function £ is a solution of equations (37). 

£o is termed the principal solution of (37). We may form the general 
solution £ by adding to £ the general solution £ x of equations (26) : £ = £o+£i. 
If the system {<p n \ is complete £i is essentially zero; then if the series (38) 
converge the equations (37) have essentially but one solution, the principal 
solution. 

If |i is a function of the class Q, £ is likewise and its norm is given by 

norm £ = norm £ + norm £i; 

for from (8) we have J*£o (n) £i = 0, so that upon applying (23), J*£oii = 0. 
Thus we have 

Theorem 14. Among the solutions of (37) no others have so small a 
norm as the principal solution except those essentially equal to it. 

The norm of £ is given by the series (38), as is clear from the Corollary 
to Theorem 9; or we may write 

J <Pl<Pl ■ ■ ■ J <Pl<Pn bi 



(39) 



norm £ = hm — 




G(<PU ■ • •> <Pn) 



An important case arises when, in (37), the functions {<p n } form a 
normalized orthogonal system, when, in particular, none of them will be 
essentially linearly dependent. Then B n = b n and series (38) becomes 
2|b„| 2 ; Theorem 13 for this case is the Theorem of Riesz and Fischer* 

Definition. Two systems of functions, {<p„} and {^„}, of the class Q 
are said to form a biorthogonal system {<p„, ip n ] in the interval a ^ x ^ b if 



I tpjtf/jdx = I (piipjdx = 
Each of the systems {<p n \, {$ n ] is called the adjoint of the other. 






* F. Riesz, Comptes Rendus, April, 1907, p. 734; E. Fischer, Comptes Rendus, May, 1907, 
p. 1022. 
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If { <p n , $n] is a biorthogonal system of functions, none of the functions of 
{<p n } or of {\f/ n \ can be essentially linearly dependent; if, for example, 

Cl<pl + c 2 <p 2 + • • • + C k <Pk = 

(essentially), we have, upon multiplying this relation by fo and integrating 
from a to b, c,- = (i = 1, 2, • • •, k). 

Now let { tp n } be a system of functions of the class Q none of which are 
essentially linearly dependent. We inquire under what condition {<?„} 
will have an adjoint system; or when the system of equations 

<«) /"Hi tit 

has a solution of the class Q for n = 1, 2, 3, • • • . A necessary and sufficient 
condition that (40) have such a solution is that the series (38) converge for 

_ f 1 (i = n), 

'"10 (t#n); 

this series, in the notation of § 4, reduces to 

g_X !(?„+!<"> I 2 lg» + 2 U) l 2 , ... 

Cr n 0r n 0rn+l "'n+lU" n +2 

or with regard to (18), 

(41) a„„ 2 + | a n +i, n | 2 + I a n+2 , „| 2 + 

Thus we have proved a theorem due to A. J. Pell:* A necessary and sufficient 
condition that a system of function { <p n } of the class ft, none of which are es- 
sentially linearly dependent, have an adjoint system is that the series (41) 
converge for n = 1, 2, 

When the conditions of this theorem are fulfilled and the system {<p n \ 
is complete the adjoint system will be essentially unique. 

9. The expressions (30)' and (39) for the norms of £i and £ suggest 
the problem of determining under what conditions the determinants in 
the numerator and denominator converge as n becomes infinite. As the 
quotient of these determinants converges we need merely inquire when the 
infinite Gramian G(<px, <p%, • • •) converges. By means of Theorem 4 and 
the theorem concerning bordered Gramians stated in the footnote to equa- 
tion (12) we may prove just as in (I), § 7, the following 

* "Biorthogonal Systems of Functions," Transactions of the American Mathematical Society, 
12 (1911), p. 141. 
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Theorem 15. A sufficient condition that the infinite Gramian of a system 
of essentially linearly independent functions \<p n \ of the class S2 converge is 
that the infinite product n„^, J \<p n \ 2 diverge to zero or converge. 

From the proof of this theorem the following corollaries follow im- 
mediately. 

Corollary 1. If the infinite Gramian of the normalized system of func- 
tions formed from {<p n } does not diverge to zero the condition that Hn^i !^ n | 2 
diverge to zero or converge is also necessary for the convergence of G (<pi, <&,-•• ). 

Corollary 2. // n n 2, \<p n \ 2 = 0, then G(<pi, <p 2 , • • •) =0. 

University of Cincinnati, 
March, 1912. 



